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O ^57) Abstract: Measurement system and method for determining a quality indicator for end-to-end data transfer in a wireless data 
O network (1). A data network analysis system (10) is connected to the wireless data network (1) for measuring at least one system 
^ performance indicator using a predefined data transfer specimen. The measurement system (10) is further equipped with processing 
means (2) which are arranged for deriving the quality indicator for at least one other data transfer type from the at least one per- 
formance indicator. The present system and method also allow to analyse the contributions to the quality indicator for determining 
underlying causes for bad performance. 
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METHOD AND SYSTEM FOR ANALYSING DATA QUALITY 
MEASUREMENTS IN WIRELESS DATA COMMUNICATION NETWORKS 

Field of the invention 
5 The Invention relates to data communication systems, and more particularly 
relates to a method and system for rrieiasuring end-to-end perceived data 
quality in wireless data communication systems. 

Background of the invention 

10 With the introduction of wireless data networks it has become important to 
measure the end-to-end quality for the different types of services that can be 
used over a (wireless) data network, not only from a technical point of view but 
also from the point of view of the user, how does the user perceive the quality 
of these sen/ices, it is already common practice to measure the data quality of 

15 a network on the lower layers of the OSI model, for example on the physical, 
transport or netwoilc layer. But for the broad acceptance of wireless data 
networks, and for the resulting commercial success. It is necessary to assess 
how the user of these wireless sen/ices will perceive the quality of the servtee. 
To be able to assess the perceived quality based on lower layer measurements 

20 it is necessary to determine how lower layer measuremente correlate with the 
perception of the quality. 

The present invention relates to field measurements because these 
measuremente provide the best correlation with user perception. The present 

25 invention particularly focuses on the end-to-end perceived quality for a service 
that will be broadly used on wireless data networks: downloading files using 
FTP (File Transfer Protocol). However, it will be clear to the person skilled in the 
art that end-to-end quality determination in other types of data transfer 
(browsing, audio/video data streaming, chatting) also may benefit from the 

30 present invention. 



CONFIRMATION COPY 
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Tools for performing field measurements on the data quality on the lower 
layers of wireless communication networks are known, see for example 
US2002/0155816, which discloses systems and methods for measuring data 
quality in a wireless communication network. One such system comprises a 

5 means for obtaining infonnation related to a tocation of the mobile wireless 
device within the wireless data networic, a means for establishing a data call 
between the mobile wireless device and the wireless data network via an 
electromagnetic signal, a means for obtaining Infomiation related to the quality 
of data service associated with the data call, and a means for con-elating the 

10 information related to the qualrty of data service with the infomiation related to 
the location of the nru}bile wireless device. 

A drawback of these existing data quality measurements systems is that 
these systems do not directly correlate the measurements on the lower layers 
to the perception of the user of the wireless data services. 

IS Problem definition and aim of the Invention 

A major drawback of existing systems for measuring data quality in wireless 
communication networi<s is that these systems do not conrelate the lower layer 
measurements, . to the perception of the perfonnance of the wireless data 
service by the user. Examples of these lower layer measurements for e.g. 
20 GPRS networi<s are "number of used timeslots". "bit/frame error rates". 

"earner/interference ratio "(C/l)" , "coding scheme usage", "cell reselections". 

The aim of the present invention Is to provide a method and system to 
assess the end-to-end quality as perceived by the user of a wireless 
datacommunication system by correlating lower layer measurements to the 
25 perception of the user. 

It is another aim of the present Invention to provide a system for Identifying 
underiying causes for a low quality as perceived by the user. 

Summary of the invention 

According to the present invention, a method is provided for detemnining 
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a perceived quality indicator for end-to-end data transfer in a data network, e.g. 
the download and/or response time or networl< throughput in a GPRS network, 
comprising measuring at least one system performance indicator during 
transfer of a predefined data type specimen, and calculating the perceived 

5 quality indicator for said predefined data transfer type and at least one other 
data transfer type from said measurementThe at least one system 
performance Indicator may be a measured lower network layer indicator which 
is indirectly or directly linked to the quality Indicator to be estimated. 

The at least one system performance indicator may in a first embodiment 

10 comprise an indirect quality indicator, i.e. an indicator which may be measured, 
but is not directly related to a perceived quality. The system performance 
Indicator may e.g. be at least one lower network layer performance indicator as 
normally measured for assessing network performance. The method further 
comprises mapping the at least one lower network layer performance 

15 parameter to the quality Indicator. The quality indicator may be an estimated 
session time for the at least one other data transfer type (or directly related 
thereto, the throughput speed for the at least one other data transfer type). 

The lower network layer performance indicators may e.g. be the percentage 
of time in which a specific coding scheme is used in the downlink, or the 

20 number of used timeslots during the download. In the case of FTP downloads, 
these performance parameters show a high correlation with actual session 
times, and can thus be used to derive estimated session times from data 
gathered from a single large file FTP download. For browsing, it has been found 
that the measured C/l value (Canier/lnterference ratio) may advantageously be 

25 used as low level performance parameter, e.g. in combination with the Number 
of used time slot parameter. 

The mapping of the measured indicators using the lower network 
layerperformance indicators may be a linear mapping (using a single 
parameter) or a multi-dimensional mapping, e.g. using two parameters (two- 
30 dimensional mapping). For FTP downloads, correlations between actual 
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session times and estimated session times have been found, with tlie 
combination of the two previously mentioned lower network layer Indicators 
providing the best result. For browsing, good results have been achieved using 
the indicators number of used time slots and averaged measured C/l value. 

5 In a further embodiment,-the measured lower network layer perfomiance 
indicators are modified to model more accurately the estimation of the session 
time. Integer values of the at least one lower network layer Iperformance 
indicator may e.g. be mapped to real values. For example, for FTP downloads, 
the number of used timeslots (an Integer value) may be mapped to reaJ values 

10 (integer value 1 is mapped as real value x1; integer value 2 is mapped as real 
value x2), and the percentage of time that an indicator has values in a 
predefined range may be clipped (e.g. all values between 0 % and 5 are 
mapped to 5%For browsing, good results have been achieved when the 
number of used time slots are mapped differently, i.e. different values for x1 

15 and x2. 

In a further group of embodiments, which may advantageously be used for 
determining estimated session times as quality indicators for FTP downloads, 
the at least one lower network layer performance indicator is a direct perceived 
quality indicator. In this case, the at least one lower network layer perfomiance 

20 indicator Is the measured throughput speed of a download of the predefined 
data transfer type specimen (e.g. a 512 kByte file), and the quality indicator is 
derived from the measured throughput speed using a moving window averaging 
estimation, in which the size of the moving window comesponds to the at least 
one other data transfer type. The at least one other data transfer type may e.g. 

25 be an FTP download of a smaller size file. 

A final perceived quality indicator is calculated in a further embodiment from 
the percentage increase In the perceived quality indicator (such as the 
estimated session time) for the at least one other data transfer type. This allows 
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to obtain a final quality figure, e.g. on a scale from 1-5, which allows easier 
interpretation and comparison. 

Underlying causes in the system may be determined from further analysis of 
the contribution of each lower network layer performance indicator to the 

5 estimated session time. To allow for analyzing the underlying causes for bad 
perfomfiance, direct and/or statistical back mapping of the at least one lower 
network layer performance indicator may be used. In this manner, it is e.g. 
possible to detenmine whether voice congestion or cell reselection is the major 
source of bad perfomnance, by looking at the contributions of various lower 

10 networic layer perfonnance indicatorss to the derived perceived quality 
indicator. 

The predefined data transfer type specimen as used for measuring the at 
least one lower network layer performance indicator (indirect or direct) in ail of 
the above described embodiments may e.g. be a FTP download of a large size 
15 file (e.g. 512 kByte). The quality indicator for data transfer types may then be 
derived fix>m this at least one lower networic layer performance Indicator. Other 
data transfer types may be FTP downtoads of different size of files (e.g. 4, 32 
and 128 kByte), a browsing session, audio streaming data, video streaming 
data, chat sessions, etc. 

20 The present method allows to derive a number of quality indicators for 

different types of data transfers using only a single field measurement (the large 
file size download). The quality indicator is e.g. a session time, such as the sum 
of the response time and download time in an FTP session. 

In a further aspect, the present invention relates to a measurement system 
25 for determining a quality indicator for end-to-end data transfer in a wireless data 
network, comprising a data network analysis system connected to the wireless 
data transfer networic for measuring at least one system performance indicator 
using a predefined data transfer type specimen, in which ttie measurement 
system is further equipped with processing means which are arranged for 



wo 2004/114701 



PCT/EP2004/006538 



6 

deriving the quality indicator for at least one other data transfer type from the at 
least one perfomnance indicator. Furthenmore, the processing means may be 
arranged to execute the method according to one of the present methods. This 
measurement system provides advantages analogue to the advantages 
5 described above in relation to the present method. 

In an even further aspect, the present invention relates to a computer 
program comprising computer readable software instructions, which when 
loaded on a computer system, provides the computer system with the 
functionality of the method according to one of the present methods. Also, the 
LO present invention relates to a computer program product, such as a floppy disc 
or CDROM, comprising a computer program according to the present invention. 



Brief Description of the Drawings 

The present invention will now be explained in further detail using a number 
15 of exemplary embodiments, with reference to the accompanying drawings. 

Figure 1 shows a system diagram of an embodiment of the present 
invention; 

Figure 2 shows a flow diagram of a general embodiment of the method 
according to the present Invention; 
20 Figure 3 shows a plot of the measured download time and the estimated 
download time using low level performance parameters; 

Figure 4 shows a plot of measured application throughput speed In adverse 
circumstances using an averaging window size of 4 sec, and the estimated 
session time for 4 KByte FTP downloads using modified low level perfomnance 
25 parameters. 



Detailed Description of the Invention 
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In figure 1, a schematic diagram Is shown of a measurement system 10, in 
which the present invention may be embodied. The data network as used in the 
following exemplary embodiments of the present Invention is a GPRS network 1 
(General Packet Radio Service), to which many users may be connected using 

5 wireless terminals 8 (only one shown in figure 1 ). Also, the GPRS network 1 
may be connected to further data or voice networks, to which further systems 
(e.g. an FTP server or a web site host sender) may be connected to allow a user 
mobile access. The GPRS network 1 is optimised for data transfer. Although 
the present invention is explained using a GPRS network 1 , the person skilled 

10 in the art will understand the invention may also be applied in other types of 
data transfer networks. 

The measurement system 10 may be connected to the GPRS-network 1 
using a proper wireless terminal 7 and a dedicated interface 6. The 
measurement system 10 comprises a processing system 2 (which may 

15 comprise one or more processors or other processing means), connected to 
input/output elements 5 (such as a keyboard, mouse, trackball, etc.), a display 
4 (such as a monitor or LCD display), and memory 3, e.g. in the form of a hard 
disk, semiconductor memory (ROM, RAM, etc.) or removable memory means 
(fk)ppy disc, CDROM, etc.). The processor 2 is anranged to execute a software 

20 program (e.g. stored In one of the memories 3) which comprises program code 
which allows the processor 2 to execute the present method. 

Since the aim of the present method is to correlate quality measurements on 
the lower layers of the GPRS network to the quality as perceived by the user, it 
is important to establish which factors determine the perception of the user. For 
25 data services (FTP file downloads, browsing sessions, streaming audio/video 
data, chat sessions, etc.) it Is known that the determining factors are: 

• The response time, the time it takes to receive the first response 

• The download time, the time it takes to send/receive the data 

• The variation in response time 
30 • The variation in download time 
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• The way the data is presented to the user 

• The data Integrity, meaning that the data is transported without errors 

For nonnal data services the TCP layer guarantees the integrity, so this 
factor is not taken into account within the present invention. 

5 It has been found that the combined effect of response and download time is 
the most significant factor that determines the end-to-end perceived qual'ity. 

With FTP there is in general no distinction made between dowmload time and 
response time and "FTP download time" (or session time) is in this application 
used to indicate the time between start and stop of the FTP session. With 
10 browsing there is in general a distinction made between download time and 
response time and in this application the sum of the two is referred to as 
"browsing time" (or session time). 

Since the aim of the present method is to connelate quality measurements on 
the lower layers of the GPRS network to the quality as perceived by the user, it 
15 is important to establish the main factors influencing the perfomiance within the 
GPRS networi^ 1 and the lower layer measurements which indicate these 
factors. These factors are known to be: 

• Congestion, which occurs If there are too many active users 

• Radio conditions, 
20 • Cell reselections 

• Server/Core network performance 

The influence of congestion is pre-dominantly seen in the time dependent 
variances of the quality, at a certain point in time the measured quality differs 
25 from the same measurement at another point in time, because the number of 
active users varies. Congestion within a GPRS network has to fomns, voice 
congestion and data congestion. Voice congestion can be detected by looking 
at the measurement of "the number of used time slots". Data congestion is 
more difficult to detect. 
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The influence of radio conditions and cell reselections is pre-dominantly seen 
in the location dependent variances of the quality, the quality differs depending 
on the location where the wireless terminal 7 is used. Radio conditions can be 
detected from "C/l" , "bit/frame error rates" and "coding scheme usage" 
5 measurements. Cell reselections can be detected by looking at the "number of 
used time slots" measurements, which drops to zero when a cell reselection 
occurs. With voice congestion this drop in "number of used time slots" rarely 
goes to zero. 

Server/Core network performance is mostly out of the control of a service 
10 provider and will especially dominate performance for high speed links. For low 
speed links, server performance should generally not be the limiting factor but it 
is clear that in assessing GPRS quality over the Internet the server and the 
public domain part of the connection that is used may have a significant 
influence. Therefore measurements that use public domain servers are not 
15 suited for field measurements. Two solutions are possible to overcome this 
problem when using the present method: 

• Using a reference connection with a reference server both outside the 
public domain 

• Comparing the GPRS performance with a standard fixed line 

20 performance and then estimate the influence of the public domain part 

of the connection 

Figure 2 shows a flow chart of an embodiment of the present method. The 
25 measurement starts by initiating a large file size (e.g. 512 kByte) download 
(block 11). During the download, lower layer performance indicators (such as 
but not limited to "throughput speed", "number of used time slots", "coding 
scheme usage", "C/l") are measured in block 12, and when needed, one or 
more of these performance indicators are modified (see below) in block 13. In 
30 the next step (block 14), the (modified) performance indicators are mapped to 
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an estimated session time using a predefined mapping function (see also the 
explanation below). The estimated session time may be used directly as and 
end-to-end perceived quality indicator, or a further perceived quality indicator 
(e.g. using a scale of one to five) may be derived (block 15). Also, it is possible 
5 to analyse the various contributions of each of the lower layer performance 
indicators to the perceived quality indicator (block 16) to determine the 
underlying causes of a bad performance. 

In the following adescription will be given for the exemplary detemiination of 
perceived quality indicators for "FTP file download" using a GPRS network 1. 

10 FTP Hnwnln ari parnftivftH qualify inriirator 

To keep the amount of final data manageable the following file sizes pan be 
used for FTP download testing: 

• 4 kByte, with download times between 4 and about 10 seconds 

• 32 kByte, with download times between 12 and about 30 seconds 
15 .128 kByte. with download times between 40 and about 1 00 seconds 

. 512 kByte. with download times between 1 40 and about 300 seconds 

As described above with reference to figure 2, two different approaches can 
be taken in the data analysis of the field measurements. In the first approach 
(block 15) the throughput speed at the application layer for a 512 kByte file 

20 download is averaged over three different time scales that approximately 
coincide with the download of the file sizes of 4. 32 and 128 kByte. For 
statistical reliability one can follow the recommendation to use the variation over 
10 downloads to estimate fluctuations in quality. From this averaged throughput 
direct predictions are made for the download times of the 4, 32 and 128 kByte 

25 flies from the 512 kByte file. These estimated session times may be used 
directly as and end-to-end perceived quality indicator. 
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Although this direct approach allows to quantify the quality it does not allow 
to find the underlying causes for bad performance. Therefore the next step is to 
analyse the data with the second assessment approach (block 16). 

The second assessment approach analyses the download results for 4, 
5 32,128 and 512 KByte files over a wide range of network conditions and tries to 
find lower layer indicators that best correlate with the download time. For each 
of the four file sizes mappings are searched for, preferably using the same 
combination of lower layer indicators for all four file sizes but with a different 
mapping. These lower layer indicators are less influenced by the 
10 transport^application layer behaviour for large file downloads and will thus also 
allow correct quality predictions on the 4kByte time scale. Furthermore the 
mapping should alk)w to analyse the underlying cause for bad performance. In 
a first analysis, to determine the mapping to be used In the present invention, 
lower layer indicators were correlated with a single linear mapping between 
15 download time and indicator, for all four different files sizes (4, 32, 128 and 512 
kByte). The best indicators were: 

• The percentage of time that a specific coding scheme is used In the 
downlink, 

• The number of used time slots in the downlink. 

20 When searching for the best two-dimensional mapping the afore mentioned 
indicator set gave the best correlation of all possible pairs. 

A first detailed analysis showed that data congestion dnd voice congestion 
are the main effects that need to be modelled accurately in order to get higher 
correlations. 

25 The indicator "number of used timeslots" is influenced by both cell- 

reselections and voice congestion. With cell-reselections the "number of used 
timeslots" is zero during the reselection process while for voice congestion it is 
decreased, e.g. from 3 down to 1 . It turned out that the impact of a lower 
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average "number of used timeslots" was far less in the case of voice congestion 
than in the case of cell reselectlons. 

An effective way of modelling can be carried out in mapping the use of 1 and 
2 time slots, as occurs with voice congestion, to the real values x1 and x2 
5 respectively (i.e. all occurrences of 1 time slot are substituted by x1 and 2 by 
x2, effectively decreasing the impact of the use of 1 and 2 timeslots). This 
modified indicator (modified low level performance indicator) is denoted by 
MOD(UsedTimeslotsDL). 

A second detailed analysis showed that the indicator for percentage of time a 
10 specific coding scheme is used, had little influence in the range between 0 and 
5%. This is most probably caused by the fact that signalling infomiation is 
always coded with the specific coding scheme so that the coding scheme 
usage below a certeiin percentage gives no information about the quality of the 
channel. This can be taken into account by mapping all values between 0 and 5 
15 % to 5% (clipping). This modified indicator is denoted 
byMOD(CodingSchemeDL). 

The final two-dimensional mapping that is used in the mapping tool (block 
14) gives a better correlation between model prediction and measured 
download time over all download times using the same indicator set for all four 

20 file sizes (4. 32, 128, 512 kByte). This con-elation is up to a level that can be 
used in a tool, especially when it is combined with the analysis of the first 
assessment approach (see below). An example of the relation between 
measured and predicted download time is given in Figure 3 for the 32kByte 
case for which the fastest download time is 12 seconds. Few points, indicated 

25 with arrows in Figure 3, show a significant deviation from the regression line 
that can be derived fi-om these measurement points. This is caused by a 
limitation of the used measurement equipment that could not correctly measure 
the utilisation of the used time slots in downlink. 
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Based on the two assessment approaches an FTP download quality 
assessment tool is implemented as a post processing on the analysis tool 
output that uses the following strategy: 

• The input to the tool is the raw output from a 512 KByte download 
5 using the analysis tool application. 

• For the file sizes of 32 KByte and 128 KByte the application throughput 
is averaged over the correct time scale (12 and 40 seconds 
respectively) and used as direct quality indicator (first assessment 
approach). 

10 • The lower layer indicator percentage of time a specific coding scheme 

is used in %, is clipped. All values between 0 % and 5 are mapped to 
5% to cope with the problem of performance saturation that occurs 
when the use of the specific coding scheme is below 5%. 

• The lower layer indicator measurements of "number of used 

15 timeslots" are modified in such a way that the difference in impact 

between a lower average number of used timeslots due to voice 
congestion and a lower average number of used timeslots due to cell 
reselections, is modelled correctly. This is carried out by mapping the 
use of 1 and 2 time slots, as occurs with voice congestion, to the real 

20 values x1 and x2 respectively. Note that this mapping gives a larger 

weight on time intervals for which no slots are available at all (due to 
cell reselections). 

From the above mentioned modified lower layer indicators the download time 
for each of the three file sizes (4, 32 and 128 KByte) is predicted by (second 
25 assessment approach) using the following mappings: 

O al - bl'^MOD (UsedTlnieslotsDI.) + d^MOD (CodxngSchemeDL) 
O a2 - b2*MQD (UsedTimeslofcsDL) -h c2«MOD (CodxngSchemeDL) 
30 O a3 * bS'^MOD (UsedTlmeslolisDI.) + cS^MOD (CodingSchemeDL) 

for 4, 32 and 128KByte files respectively, in which a1,a2, a3, b1, b2, b3, c1, 
c2, c3 are predetermined mapping coefficients. 
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The tool allows to further analyse the underlying cause of bad performance 
by: 

• Checking the prediction difference between the download time derived 
from the application throughput (first assessment approach) with the 

5 download time derived from the lower layer mapping (second 

assessment approach). A large difference indicates a limitation In the 
measurement equipment that could not correctly measure the 
utilisation of the used time slots in downlink (see arrows in Fig. 3). 

• Analysing if the main contribution comes from either the 

10 MOD(CodingSchemeDL), indicating poor radio performance, or from 

MOD(UsedTimeslotsDL), indicating voice congestion or cell 
reselection. 

• Analysing the distribution of the number of used timeslots indicator. 
When many zero's are present cell reselection dominates the quality, 

15 when the values 1 and 2 dominate the distribution, voice congestion 

dominates the quality. 

Figure 4 shows an example of the estimated download time of a 4 kByte file 
from the download of a large 512 kByte file under bad circumstances using the 
lower layer prediction. 

20 Other applications 

The present invention can also be applied for other data transfer types than 
the FTP file download as discussed In the example above. Further possible 
applications in which end-to-end perceived quality can be determined using the 
present invention include, but are not limited to, browsing, streaming audio, 
25 streaming video, chatting etc. For each of the different types of applications, 
other (combinations of) performance indicators (direct performance indicator(s) 
such as throughput speed, or indirect performance indicator(s) such as number 
of used cells, etc (see above)) may be used. 

Perception based assessment procedure 
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This section deals with the problem of how to interpret the time variant 
behaviour for each of the three file sizes (4, 32. 128 l^Byte, coinciding with the 
time scales of 4. 12 and 40 seconds). For the largest file (512 kByte) quality is 
measured directly from the download time of the file and time variant behaviour 
5 has to be assessed on the basis of multiple downloads (e.g. 10 downloads as 
recommended). 

The basic idea in the data interpretation is that the download time has to vary 
over more than 25% in order to have a perceptual effect and has to vary by a 
factor of two for perceiving a significant degradation. The idea of quality 
10 categorization can be used for both FTP download and browsing. This leads to 
the following quality classes using the ITU-T 5 point rating scale. 

, % increase in download / browsing time < 25: Excellent quality ' 

, 25 ^ % Increase In download / browsing time < 50: Good quality 
, 50 ^ % increase in download / browsing time < 100: Fair quality 
15 • 100^% increase in download /browsing time < 200: Poor quality 
• % Increase In download / browsing time ^ 200: Bad quality 

Using this categorization one can quantify the time variant behaviour of the 
networic, over the duration of the 512 kByte download, for each of the three file 
sizes for FTP download and for the browsing session. If a complete quality 
20 analysis is required one should thus calculate the percentages in each class 
(i.e. % excellent, % good, etc.) and use those five numbers to quantify the end- 
to-end quality for each of the four file sizes and the browsing session 
separately. For quantifying the time variant behaviour on the largest time scale 
(>140 s) one has to perform multiple FTP downloads of the 512 kByte file. 

25 A first global quality analysis in the final post processing tool is earned out by 
calculating the percentage poor or bad as is commonly used in speech 
transmission quality assessment. This percentage is calculated from the lower 
layer indicators as well as from the application throughput (see above). This 
allows for an easy to interpret small set of quality numbers. For each of the 

30 three FTP download time scales and the single browsing time scale, two quality 
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numbers in the form of a percentage poor or bad, are thus given. When they 
are about the same the degradation is not caused by data congestion, when 
they are significantly different data congestions plays an important role. 

By a further analysis of the lower layer indicators one can find the cause for 
5 bad performance. When the average MOD(CodingSchemeDL) is high and C/l 
is low, then bad radio performance dominates the quality. When the average 
MOD(UsedTimeslotsDL) is low then voice congestion or cell reseleclion 
dominates the quality. By checking the distribution of ttie indicator number of 
used timeslots one can distinguish voice congestion from cell reselections. 
10 When many zero's are present cell reselection dominates the quality, when the 
values 1 and 2 dominate the distribution, voice congestion dominates the 
quality. 

For the person skilled in the art, it will be clear that the above exemplary 
embodiments are only described for a better understanding. The exemplary 
15 embodiments are not meant to limit the scope of this application, which is 
defined by the appended claims. 
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Qlaims. 

1 . Method for determining a perceived quality indicator for end-to-end 
data transfer in a wireless data network (1), comprising 

measuring at least one system performance indicator during transfer of a 
5 predefined data type specimen, and 

calculating the perceived quality indicator for said predefined data transfer type 
and for at least one other data transfer type from said measurement. 

2. Method according to claim 1 , in which the at least one system 

10 performance indicator comprises at least one lower network layer performance 
indicator further comprising 

measuring at least one other lower network layer performance indicator 

and 

mapping the at least one other lower network layer performance 
15 indicator to the perceived quality indicator. 

3. Method according to claim 2, in which the mapping is a linear 
mapping, e.g. a linear two-dimensional mapping. 

20 4. Method according to claim 2 or 3, in which the at least one lower 

network layer performance indicator is a modified lower network layer 
performance indicator. 

5. Method according to claim 4, in which integer values of the at least 
25 one lower network layer performance indicator are mapped to real values. 

6. Method according to one of the claims 1 through 5, in which the at 
least one lower network layer performance indicator is the throughput speed, 
and the quality indicator is derived from the measured throughput speed using 

30 a moving window averaging estimation, in which the size of the moving window 
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corresponds to the at least one other data transfer type. 

7- Method according to one of the claims 2 through 6, in which a final 
quality indicator is calculated from the percentage increase in the quality 
indicator for the at least one other data transfer type. 

8. Method according to one of the claims 2 through 7, in which the 
method further comprises the step of analysing the contribution of each of the 
at least one lower network layer performance indicator. 

9. Method according to one of the claims 1 through 8, in which the 
predefined data transfer type specimen Is a FTP download of a large size data 
file, e.g. 512 kByte. 

10. Measurement system for determining a quality indicator for end-to- 
end data transfer in a wireless data network (1 ), comprising 

a data network analysis system (10) connected to the wireless data network (1) 
for measuring at least one lower network layer performance indicator using a 
predefined data transfer specimen, 

in which the measurement system (10) is further equipped with processing 
means (2) which are arranged for deriving the perceived quality indicator for at 
least one other data transfer type from the at least one lower network layer 
performance indicator. 

11. Measurement system according to claim 10, In which the processing 
means (2) are arranged to execute the method according to one of the claims 2 
through 9. 
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Fig 2 
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Fig 3 
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